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Abstract 

The goal of this research is to achieve very intelligent telerobotic controllers which are capable of receiving high- 
level commands from the human operator and implementing them in an adaptive manner in the object/task/manipulator 
workspace. This p fi ppr presents initiatives by the authors at Integrated Systems, Inc. to identify and develop the key 
technologies necessary to create such a flexible, highly programmable, telerobotic controller. The focus of the discussion is 
on the modeling of insertion tasks in three dimensions and nonlinear implicit force feedback control laws which incorporate 
tool/workspace constraints. Preliminary experiments with dual arm beam assembly in 2D ar^ presented. 
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I. Introduction 

In the future, telerobotic manipulators will be used to enable increased space assembly, servicing, and repair. Specific 
goals, as determined by NASA, are: 

1) “to decrease mission operations manpower by 75 percent, 

2) to replace 50 percent of extravehicular aciivity (EVA) with telerobotics, and 

3) to enable remote (e.g. geosynchronous earth orbit and polar orbit) assembly, servicing, and repair through tele- 
robotics” jl|. 

In order to satisfy the above requirements for telerobotics, significant improvements in manipulator control will be 
necessary. Telerobotic assembly requires powerful locally autonomous control laws for l)task completion in the presence of 
disturbances and sensor errors 2) control of position and force for trajectory guidance 3) task completio .vithout continuous 
operator supervision. The last is especially important for long distance tasks (such as Mars exploration) where the time delays 
involved in receiving sensory information or relaying earth-based control signals make traditional teleoperation unsuitable. 
Furthermore, an interface for expert system planners and/or human interaction will be necessary so that the system is flexible 
to various levels of human supervision. 

Previous work in the general area of robotics has focused on a decompositou of robot control into trajectory planning 
and servocontrol to the preplanned wire in statespace. A logical extension of this work approaches the problem with real-time 
expert systems to formulate the planned trajectory “in-the-loop”. Expert systems “in-the-loop” will be much more powerful 
with more-sophisticated control algorithms as a foundation. Namely, analytic, optimization based, “trajectory feedback , 
nonlinear control laws whose performance index and time phasing are controlled by a combination of expert systems and the 
human operator. 

The effort described below involves fundamental nonlinear control laws valuable in dual arm coordination. These 
approaches to dextrous, coordinated motion were evaluated in a new highly flexible simulation environment [2). The authors 
have modeled 'wo 3DOF planar robots, performing a beam assembly task. Two dimensonal plots and figures illustrate by 
comparative resuits the sensitivity of performance to the control law structure. Reasonable long term research conclusions 
will be 

a) which control approaches are most reasonable 

b) what level of actuator/sensor performance is required to do meaningful experiments well with these control laws, 

and 
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c) what are the controller architecture laaues to implement such control laws. 

We first deecribe the modeling, then varioua control atructurea followed by a discussion of the experimental results. 

II. Dual Arm Modeling 

Modeling and Simulation Tools 

The following research was carried out using MATRiX x /AR (Automation and Robotics Modeling and Simulation 
Package) [2|. This tool provides a flexible modeling and simulation environment for manipulators, actuators, ^control [**»• 
Figure 1 is a flowchart for the use of MATRIX x /AR. Model creation is initiated by using the ^^‘djiven RUI (Robo c 
User Interface) to specify the geometric, inertial, and functional specifications of the manipulator. The RUI creates a rob 
database from the given and computed data. This data is accessed by command files which budd a kinematjc and dynamic 
model of the manipulator using the recursive Newton-Euler approach. This model is created m S \^T EM .D UI LD[3| , a 
simulation/integration package where linear, nonlinear, and multirate systems and controllers can be modeled quickly and 
easily in a block diagram format. Figure 2 shows the inverse dynamic model of the PUMA 560 with bl “ ks for 
wrist, and end effector. The blocks are nested, so that the block To, .he arm contains for link l ’ hnk 2 ’ and nk ’ . 

of which contains a dynamic, kinematic, and actuator block. By using input flags, the PUMA block J* i^and mode n 

kinematic, dynamic, and inverse dynamic information. Suitable control laws can be generated by using classical and 
control design techniques available in MATRIX x /AR. The plant and control models are combined in an overall system which 
is then simulated. Post-processing animation capabilities are used to visualise the success or failure of a particular controller. 


Manipulat or Robot Models 

Each of the two robot! : manipulators modeled in this study is a three DOF articulated arm. The arms are made 
up of three rigid links connected through one prismatic and two revolute joints. Since the first and second joint axes are 
perpendicular, and the second and third are parallel, each arm moves in a plane with one translational and two rotational 
degrees-of-freedom. A schematic of an arm is shown in Figure 3. 

The 3- DOF planar manipulators are identical, with the physical characteristics shown in Table 1. 



Figure !. MATRlX x /AR Design Flowchart. 


Spa ce Assembly Beam Model 

The mating of two long slender beams was chosen as a suitable test for the proposed control algorithms. The beams 
were sized relative to the arms to simulate a truss assembly scenario. The beams, as well as the manipulators, have a 
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Figure 2. Model of PUMA 560. 


cylindrical (hollow) shape with the dimensions shown in Table 1. 

The dual arm configuration, complete with beams, is shown in its initial position in Figure 4. The arm and beam 
on the left with the socket will be referred to as Manipulator 1, and thoee on the right with the peg as Manipulator 2. The 


Table l 


3-DOF Planar Manipulator Physical Characteristics. 


Geometric 

Properties 

Link 1 

Link 3 

Link 3 

Beam 

Joint Type 

Swivel 

Sliding 

Hinge 

n/a 

Length (m) 
Cylinder: 

.2 

.4 

.4 

1 

Inner Radius (m) 

.046 

.0335 

.0335 

.023 

Outer Radius (m) 

Inertial 

Properties 

.050 

.0375 

.0375 

.025 

Mass (Kg) 
Inertias (Kg-m 3 ): 

.724 

1.07 

1.07 

.905 

/** 

.0017 

.0014 

.0014 

.0005 


.0032 

.0149 

.0149 

.0757 

iZ 

.0032 

.0149 

.0149 

.0757 


desired goal invokes inserting a peg on the left end of the second beam into the hole in the middle of the first beam. 

Dual A r m Constraint Mode l 

Simulating closed dynamic chains, such as the dual arm manipulators during an assembly task, is a difficult problem. 
The collisions which occur during insertion result in abrupt changes in the motion (velocity) states. These discontinuities 
cause problems for the integration package. The problem is dealt with in this research by using a compliant model, since 
there is, naturally, compliance in any mechanical mechanism. For this work, the first arm, second arm, and second beam 
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are treated as being rigid. The hole and the second beam are compliant, generating an opposing force linearly proportional 
to the amount of deflection caused by the inserting peg upon collision. Since computer CPU time is dependent upon the 
“stiffness" of the equations, preliminary tests are run using relatively low spring constants. The results described below are 
in this category, with spring gains of 1000 N/m. 


III. Dual Arm Control 

This section gives an overview of the various aspects of the control approaches investigated on a dual arm experiment. 
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Figure 4. Lual Arm Configuration. 


I 


3.1 Control Design 

The performance of a robotic manipulator in a compliant task, such as peg insertion, greatly depends on the choice of 
control used. A one-step control law based on previous research [4] was used for the beam assembly problem described above. 

f 
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The advantage of this scheme over typical hybrid force/position control is that the control law works for both constrained 
and unconstrained motion; thus, the peg does not need to be in close proximity to the hole initially. A brief description of 
the control law is presented below. 


Nonlinear Control 

The equation of the motion of the end effector in cartesian space is given by 

A(x)2 + n(x, x) + p[x) - F (1) 

where x is a vector of position and orientation, p(x, x) contains the Coriolis and centripetal terms, and p{ x) contains the 
gravity terms. A nonlinear control law can be used to globally linearise equation (1) (5]. The result is a linear system of the 
form 


£ = F c . ( 2 ) 

Multiplying (2) on both sides by A(x) and adding p(x,x) + p(x) gives 

A(x)x + m(x,x) + p(x) = A(x)/; 4- n(x,x) 4- p(x) 

Letting F = A(x)F 0 + p(x, x) + p(x) = A(x)F e + F d , where Fd = p(x, x) + p(x), the feedback is composed of two components: 
a component containing the feedback law designed for the linear system (2), and a nonlinear decoupling component based on 
the nonlinear terms of (l). It is important to note that exact nonlinear control requires a precise model of the manipulator. 

Constrained Motion Control 

Control in the presence of constraints was based on research done by Ish- Shalom [6]. The method involves specifying 
a task constraint and then using that constraint as the optimisation criterion for a linear quadratic optima) control design. 
For example, the constraint on the end effector force and velocity 


f-v = 0 

describes sliding along a surface. A linear quadratic controller can be designed to satisfy this constraint. It is based on 
minimizing the performance index 


; = ll/..|| I = « T /f(/)» 


and is derived for system (2) with the following result [4|: 


F e = -Kx 


K = [K, *„] 

= [° 7sW>] 


where K p is positional feedback, K v is velocity feedback, a is a constant, and 



/«/„ 

fi 

/*/. 


ij, 
/»/* 
n J 


> 0 


v/eR* 


Note that the force is controlled implicitly through the velocity feedback. 


t/nconstrained Motion Control 

Control in the absence of constraints can be determined by using linear quadratic optimal control. The solution for 
system (2) will provide position and orientation control for the manipulator. 
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3.2 Dud Arm Beta Assembly Control Strategies 

The three control tews described above were combined and used with the dual arm configuration described In chapter 
2. Three preliminary control strategies, shown in Table 2, were chosen to determine preliminary conclusions on the importance 
of implicit force control and relative vs. global cooperative control schemes. 


Table 2 

Dual Arm Control Strategies Simulated 


Ex. 

Control 

. 

Strategies 

# 

arm 1 

(Socket Receptor) 

arm 2 

(Insertion Peg) 

■ 

NL 

global servo 

NL-force 
global servo 

■ 

NL- force 
global servo 

NL-force 
global servo 

3 

NL-force 
global/ 
local servo 

NL-force 
global servo 


A global servo means the control is servoing to a point in inertial space. A local servo means that one arm servos 
relative to the other arm. The nonlinear aspect is what is often called the coupled torque method, and the force control is 
alt implicit based on the constraint modeling described above. The next section describes the motivation for these strategies 
and experimental simulation results. 

IV. Dual Arm Simulation Results 

The first experiment tests the performance of control laws without coordination. The second experiment adds implicit 
force control to give a local coordination effect, and the third shows how significant passing information on the other arm's 
activity is to accomplish a coordinated assembly task. 

Experiment 1 Objectives and Results 

In experiment 1 both arms were servoed to a globally defined position and orientation. The defined position for 
both arms corresponds to the base point of the hole in the beam attatched to arm 1. Arm 2 was controlled by the combined 
controller as described above. Arm 1 however, did not have implicit force control. The simulation results are shown for 
successive time frames in Figure 5. Note that the initial contact of arm 2 onto arm 1 caused significant deflection, so that 
mating was only possible, after a second attempt. 

Experiment 2 Objectives and Results 

Experiment 2 was the same as the experiment 1 with the exception that arm 1 was given implicit force control. 
As can be seen in Figure 6, the mating was accomplished in the first try. This is due to the cooperative motion of the 
manipulators after contact, even though they had no information about each others positions and were servoed to a globally 
defined point in space. The presence of the implicit force in arm 1 caused that arm to move in the positive z direction after 
being hit by arm 2 (perpendicular to the direction of the external force) rather than in the -x direction as before. Thus, local 
relative movement (away from the defined servo point) occured with arm 1 which allowed the two beams to mate faster and 
then travel back together to the global servo point. 

Experiment 3 Objectives and Results 

Experiment 3 was the same as experiment 2 with the exception that arm 1 was given information about the z 
component of the peg’s location (attatched to arm 2). Arm 1 was thus servoed globally in the x direction and relatively (to 
arm 2) in the t direction. As can be seen in Figure 7, faster mating was obtained due to global movement of arm 1. 
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Simulation Experiment Summary and Conclusions 

It should be noted that the above experiments represent preliminary resulta run under idealized conditions. The 
nonlinear control was exact and the hole was modeled compliantly as a spring system, allowing the manipulator to penetrate 
the first beams surface and then apply a point force proportional to the maximum penetration. These simulations were 
designed, however, to illustrate the potential benefit of using nonlinear implicit force feedback. Two key observations can be 
made. 

First, the presence of implicit force feedback in both arms demonstrated how the two arms were capable of moving 
cooperatively without any knowledge of each other. The implicit force feedback allowed local movement about the globally 
defined servo point, which resulted in cooperative relative movement for the arms. This is extremely valuable since this esm 
compensate for sensor inaccuracies in specifying and measuring the global servo point. 

Second, as should be obvious, giving one or both arms information about each other, such as positional information, 
allows a greater degree of cooperation in the assembly task. Thus, future research will concentrate on using cooperative 
schemes, such as dual arm one-sided optimal guidance, to increase the amount of cooperation between the two arms. 

V. Summary 

This paper has outlined telerobotic research in progress at Integrated Systems. The emphasis on the work has been 
to develop goal directed guidance laws which provide a more powerful framework for telerobotic planners and teleoperator 
controllers to interface. Preliminary work has been done to test the concepts by simulation, using flexible automation 
modeling and control tools developed at Integrated Systems. 

The dual arm control laws tested show that the control strategy is very important for assembly operations and could 
be of great benefit to NASA’s space bound manipulators. Since there is a major need for telerobots to possess significant 
decision-making capabilities before they can be used extensively in remote and hazardous situations, it will be valuable in 
the industrial and nuclear environments as well. 
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Figure 7). Experiment 3 Results - Global and Local Servo ing With Two-Sided Implicit Force Coordination (see Table 2) 
a) 0-1.75 secs, b) 2.25-3.25 sees, c) 3.75-6.0 secs. 
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